[nltk_data] Downloading package stopwords to /root/nltk_data...
[nltk_data]   Unzipping corpora/stopwords.zip.

Rewards Analytics and Distribution Dashboard for Quantification Review¶

This document processes the outputs of the praise reward system and performs an analysis of the resulting token reward distribution.

Out[6]:

Distribution report for round-46

  • This period covers praise given between 2024-09-02 and 2024-09-30.
  • We allocated a total of 37893.333333333336 TEC tokens for rewards.
  • Duplicate praise received a weighting of 0.1 the value of the original praise.
  • We assigned 3 quantifiers per praise instance.
  • Praise receiver names were not hidden behind pseudonyms during quantification

Praise Data Visualization¶

Rating distribution¶

Since praise gets valued on a scale, we can take a look at how often each value of the scale gets assigned by quantifiers. Note: This metric disregards scores of praise marked as a duplicate, since the score of the original is already being taken into account.

Top 10 highest rated contributions¶

The ten highest rated contributions for this round were the following:

Out[9]:
Avg. score To Reason
89.0 snakey_jakey. for all the coordination and follow up on grants and grants review, and for being such a good griff babysitter. he puts loads of effort into making sure we jump onto all the important fundraising opportunities, and I'm always in awe of his organization and comms efforst
70.6666666666667 snakey_jakey. for absolutely cleaning up in the GG21 rounds! Their work brought in a lot of revenue into Giveth by showcasing the work we've done and securing big matching funds to continue funding our team
66.3333333333333 giantkin#0 for doing great moderation work of catching spammers and scammers in our discord and hitting them with the ban hammer always in record time.
59.3333333333333 oyealmond#0 for drafting the content of like a billion different features and announcements and organizing all of the required comms tasks. It's incredibly overwhelming all of the different things happening in Giveth right now and she is doing a great job of trying to keep the comms running for it all
59.3333333333333 griffgreen#0 for constantly pushing Giveth forward every day! 🙌 I've been writing our newsletters for a while, but the August edition had the most updates by far—it was tough not to include every single one.
59.3333333333333 marcelorefi for absolutely cleaning up in the GG21 rounds! Their work brought in a lot of revenue into Giveth by showcasing the work we've done and securing big matching funds to continue funding our team
52.3333333333333 oyealmond#0 for collaborating to put together a really informative, exciting and interesting GIV essentials for the whole community. I think it went super well! gave a lot of interesting context & updates. I think it was great for both keeping people looped in and building a strong sense of community
45.3333333333333 griffgreen#0 for crushing some hard 12 hr shill days with me at EBC10 this past week. You have so much energy and drive, it ALWAYS impresses me to witness IRL
45.3333333333333 steetweets for their continued work on promoting DeVouch, scheduling spaces, pushing out tweets and social media content, drafiting content calendar and even creating video content. their work is greatly needed to get DeVouch in front of the ecosystem and to discover its potential
43.6666666666667 karmaticacid#0 for absolutely cleaning up in the GG21 rounds! Their work brought in a lot of revenue into Giveth by showcasing the work we've done and securing big matching funds to continue funding our team

Praise Reward Distribution¶

We can now take a look at the distribution of the received praise rewards. You can toggle the inclusion of the different sources by clicking on the legend.

Praise Giving Distribution¶

We can also take a look at the amount of praise different users gave.

Praise Flows¶

Now for something more fun: let's surface the top "praise flows" from the data. Thanks to @inventandchill for this awesome visualization! On one side we have the top 15 praise givers separately, on the other the top 25 receivers. The people outside the selection get aggregated into the "REST FROM" and "REST TO" categories.

Out[13]:

Quantifier Data¶

Now let's take a closer look at the quantification process and the quantifiers:

Praise Outliers¶

To aid the revision process, we highlight disagreements between quantifiers.

Outliers sort by spreads¶

This graphic visualizes controversial praise ratings by sorting them by the "spread" between the highest and lowest received score.

Please keep in mind that this is a visual aid. If there are several praise instances with similar spread and quant score, all but one end up "hidden" on the chart. For an exhaustive list, take a look at the exported file "praise_outliers.csv" .

Praise score by quantifier -- outliers among the quantifiers?¶

Let's see how different quantifiers behaved by showing the range of praise scores they gave.

To interpret the box plot:

  • Bottom horizontal line of box plot is minimum value

  • First horizontal line of rectangle shape of box plot is First quartile or 25%

  • Second horizontal line of rectangle shape of box plot is Second quartile or 50% or median.

  • Third horizontal line of rectangle shape of box plot is third quartile or 75%

  • Top horizontal line of rectangle shape of box plot is maximum value.

Score displacement: tendency to under/over-scoring?¶

Scoring correlation: how similiar am I scoring with others?¶

Agreement on duplication¶

Out[22]:

Among 245 praises, 27 (11.02%) do not agree on duplication

Praise instances with disagreements in duplication are collected in 'results/duplication_examination.csv'. To compare, look at the last 4 columns: 'DUPLICATE MSG 1/2/3' and 'ORIGINAL MSG'.

Agreement on dismissal¶

Out[25]:

Among 245 praises, 1 (0.41%) do not agree on dismissal

Praise instances with disagreements in dismissal are collected in'results/dismissal_disaggreed.csv'. You can further look into who dismissed and who did not.